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Abstract. The rigorous linking of exact stochastic models to mean-field ap- 
proximations is studied. Starting from the differential equation point of view 
(_P ' the stochastic model is identified by its Kolmogorov equations, which is a 

Ch ' system of linear ODEs that depends on the state space size (A'^) and can be 

written as iipf = Ajv"jv- Our results rely on the convergence of the transi- 
fl\ ■ tion matrices Ajv to an operator A. This convergence also implies that the 

r^\ ' solutions u^ converge to the solution u of u = Au. The limiting ODE can be 

easily used to derive simpler mean-field-type models such that the moments of 
\0 , the stochastic process will converge uniformly to the solution of appropriately 

chosen mean-field equations. A bi-product of this method is the proof that 

the rate of convergence is 0{1/N). In addition, it turns out that the proof 

holds for cases that are slightly more general than the usual density dependent 

^^ , one. Moreover, for Markov chains where the transition rates satisfy some sign 

LJ 1 conditions, a new approach for proving convergence to the mean-field limit is 

proposed. The starting point in this case is the derivation of a countable sys- 
tem of ordinary differential equations for all the moments. This is followed by 
J^ , the proof of a perturbation theorem for this infinite system, which in turn leads 

to an estimate for the difference between the moments and the corresponding 
quantities derived from the solution of the mean-field ODE. 
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1. Introduction 



OO ' General birth-and-death models are at the basis of many real-world applications 



ranging from queuing theory to disease transmission models, see Grimmett and 



t^^ ' Stirzaker |^. In particular, the analysis of such models involves the consideration 

^— ^ ■ of Kolmogorov equations that simply describe the evolution of the probability of 

a certain process being in a given state at a given time. One of the major draw- 
backs of this approach is the large number of equations. This is very limiting from 
an analysis viewpoint, and in addition, it also precludes the construction of a nu- 
K^ . merical solution of the full or complete set of equations. Using techniques such 

Vh ' as lumping in Simon et al. [18) this can be circumvented and an equivalent exact 

system with a tractable number of equations can be derived. However, often this 
technique only works in the presence of significant system symmetries such as in 
the case of a simple disease transmission model on a fully connected graph where 
all nodes are topologically identical. This requirement rarely holds and highlights 
the importance of approaches that deal with the complexity of the large number of 
equations. Progress in this direction has been made as illustrated by the important 
contributions of Kurtz |8] , Bobrowski [4] and Darling and Norris . 
Here we take a dynamical system type approach, where the Kolmogorov equations 
are simply considered as a system of linear ODEs with a transition rate matrix 
having specific properties such as special tri-diagonal structure and/or well defined 
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functional form for the transmission rates. For example, consider a Markov chain 
with finite state space {0, 1, . . . ,N} and denote by Pk{t) the probability that the 
system is in state k at time t (with a given initial state that is not specified at the 
moment). Assuming that starting from state k the system can move to either state 
/c — 1 or to state fc + 1, the Kolmogorov equations of the Markov chain take the 
form 

(KE) pk ^ l3k-iPk-i - akPk + Sk+iPk+i, k = 0,...,N, 

or, introducing the tri-diagonal matrix 
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and the coloumn vector p{t) 



(Po{t),Pl(t),---,PN{t))'^, 
p{t) =. ANp{t). 



The assumption on the tri-diagonality of the matrix can obviously be weakened, 
however, most practical problems that motivate our work fall into this class. There- 
fore, to be in line with applications and to make our results more transparent, the 
tri-diagonal case will be considered. 

Here we assume that the coefficients fik and 5k arc asymptotically density dependent 
in the sense that 

(1.1) pk^BN{k), Sk^DNik), 

and the following limits exist for all x G [0, 1], 

Bn^Nx) 



(1.2) 



lim 

W-5-CO 



N 



5{x) 



lim 

N^oo 



DnJNx) 

N 



with f3 and S (at least) continuous functions, and 
(1.3) ak^l3k + Sk, k^O,. 



,N. 



We note that the usually used density dependence means that (3{x) — "]y ^' for 
all N (similarly for Dj^). 

In order to get a differential equation approximation of the Markov chain for N — > 
oo, the random variables XN{t), forming a continuous time Markov process, with 
values in 

0,1,4 1 



are considered. Then 



N' TV' 



Pk(t)^P[XN{t) 



k 

N 



can be expressed in terms of the transition probabilities as 

N 

Pkit) =^Pj,fc(t)pj(0), 
j=o 

where the transition probabilities are 

PjAt) = P \XN{t) 



N 



Xn{0) 



N 
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Combining this with the Kolmogorov Equation (IKEp , it is straightforward to show 
that the transition matrix is given by 



^A i^rt 



e 



As a simple calculation shows in Subsection I3.b[ the approximating mean-field 
differential equation to the Markov chain can be written as 

(1.4) x = P{x)-5{x). 

The problem of rigorously linking exact stochastic models to mean-field approxi- 
mations goes back to the early work of Kurtz |13l 114) . Kurtz studied pure-jump 
density dependent Markov processes where apart from providing a method for the 
derivation of the mean-field model he also used solid mathematical arguments to 
prove the stochastic convergence of the exact to the mean-field model. His ear- 
lier results |13l 114] relied on Trotter type approximation theorems for operator 
semigroups. Later on, the results were embedded in the more general context of 
Martingale Theory [8]. A detailed survey of the subject from the probabilistic point 
of view is by Darling and Norris "S" . Building on this and similar work, McVinish 
and Pollett |16| have recently extended the differential equation approximation to 
the case of heterogeneous density dependent Markov chains, where the coefficients 
of the transition rates may vary with the nodes. The results by Kurtz and others 
in this area have been cited and extensively used by modelers in areas such as ecol- 
ogy and epidemiology to justify the validity of heuristically formulated mean-field 
models. The existence of several approximation models, often based on different 
modelling intuitions and approaches, has recently highlighted the need to try and 
unify these and test their performance against the exact stochastic models, see 
House and Keeling [IT] . Some steps in these directions have been made by Ball and 
Neal, and Lindquist el al. [H [T^ , where the authors clearly state the link between 
exact and mean-field models. 

The probabilistic approach given by Ethier and Kurtz, and Darling and Norris in 
[SI E4 yields weak or stochastic convergence of the Markov chain to the solution of 
the differential equation. Here we have a more moderate goal, namely to prove that 
the expected value of the Markov process converges to the solution of the differential 
equation as A^ — >■ 00, and to prove that the discrepancy between the two is of order 
1/A^. The benefit of framing the question in this simpler or different way lies in 
a less technical and more accessible proof. This will mainly rely on well-known 
results from semigroup theory compared to the combination of highly specialist 
tools and results from probability theory. For the applied semigroup methods see 
also Batkai, Csomos and Nickel [31 and references therein. This simpler approach, 
based on the expected value of the Markov chain, is also motivated by practical 
considerations, namely that usually the goodness of the approximation is tested 
by comparing the average of many individual simulations to the output from the 
simplified approximate model. This can be a satisfactory and sufficient comparison 
since, according to our knowledge, weak and stochastic converges is rarely tested. 
The main result of the paper can be formulated in the following Theorem, where 
we assume uniformity for the convergence in (|1.2p . 

Theorem 1. Let 

^ k 

fc=0 

be the expected value and let x be the solution of Jj.^p with initial condition x(0) = 
2/1(0). Let us assume that the limits in (|1.2p are uniform in the sense that there 
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exists a number L, such that for all x £ [0, 1] 

(1-5) \P{x) J^\^J^- 

Then for any to > there exists a constant C , such that 

\x{t)-yi{t)\<^, te[0,to]. 

Since the essence of the Theorem is well-known we highlight the novelties of our 
approach in the paper. 

• The proof is self-contained in the sense that no general, abstract, theorem 
or combination of theorems are used. The result is based on the simple fact 
that if the operators A]S! converge to the operator A in a certain sense as 
N ^ oo, then the operator semigroup T/v generated by An converges to 
the semigroup T generated by A. This result is formulated in Lemma [SJ 

• The proof automatically implies the rate of convergence, namely it can be 
shown that the difference between the expected value and the solution of 
the mean-field ODE is of order 1/iV. 

• Our tools make it possible to extend the above convergence results from 
density dependent Markov chains to the more general case of asymptotically 
density dependent Markov chains. 

• For Markov chains where the transition rates satisfy some specific sign con- 
ditions, a completely new approach is presented. This is based on deriving 
a countable system of ordinary differential equations for the moments of a 
distribution of interest and proving a perturbation theorem for this infinite 
system. 

The paper is structured as follows. In Section 2 we motivate our work via two exam- 
ples and/or applications: an adaptive network model with random link activation 
and deletion, and a SIS type epidemic model on a static graph. The derivation of 
ODEs for the moments is presented in Section 3 together with the heuristic con- 
struction of the mean-filed equation for the first moment. In Section 4, we present 
our new approach and use it to prove Theorem 1. In Section 5, we present the 
derivation of an infinite system of ODEs for the moments (only in the density de- 
pendent case) and we show how this leads to a new approach that can be used to 
derive estimates for all moments, directly from the ODE. This is contrast with the 
usual approach where only the expected value of the Markov chain is estimated. 



2. Motivation 

In this Section we present two important examples that motivate our investigations. 
Recently, it has become more and more important to understand the relation be- 
tween the dynamics on a network and the dynamics of the network, see Gross and 
Blasius [TD] . In the case of epidemic propagation on networks it is straightforward 
to assume that the propagation of the epidemic has an effect on the structure of 
the network. For example, susceptible individuals try to cut their links in order to 
minimize their exposure to infection. This leads to a change in network structure 
which in turn impacts on how the epidemic spreads. The first step in modeling 
this phenomenon is an appropriate dynamic network model such as the recently 
proposed globally-constrained Random Link Activation-Deletion (RLAD) model. 
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This can be described in terms of Kolmogorov equations as follows, 



dt ' ' ''V -^r 

{N - fc) (^1 - -j^^ +ujk pk{t)+uj{k + l)pk+i{t), 
0, . . . , TV, 



where pk (t) denotes the probability that at time t there are k activated links in the 
network, and N is the total number of potential edges. It is assumed that non- 
active links are activated independently at random at rate a and that existing links 
are broken independently at random at rate w. Furthermore, the link creation is 
globally constrained by introducing a carrying capacity K™""^, that is the network 
can only support a certain number of edges as given by K"''"'^ . 
Using the above notation, here 



Pk = a{N-k)n-^^^j , Sk=ujk, ak^Pk + Sk, k = 0,...,N, 

a-i = Sn+1 = 
with Kf^^^ being of order N. These coefficients clearly satisfy (|1.2p and (|1.3I) . 

The second motivation comes from epidemiology where a paradigm disease trans- 
mission model is the simple susceptible-infected-susceptible (SIS) model on a com- 
pletely connected graph with N nodes, i.e. all individuals are connected to each 
other. From the disease dynamic viewpoint, each individual is either susceptible 
(5) or infected (/) - the susceptible ones can be infected at a certain rate (/3) if 
linked to at least one infected individual and the infected ones can recover at a 
given rate (7) and become susceptible again. It is known that in this case the 2^- 
dimensional system of Kolmogorov equations can be lumped to a iV-Hl-dimensional 
system, see Simon, Taylor and Kiss [IH]. 
The lumped Kolmogorov equations take again the form (|KE[) with 

/3k^(3k{N^k)/N, Sk^-fk, ak^Pk+Sk, k^O,...,N, 
13-1 = Sn+1 = 0. 



These coefficients also satisfy (jl.21) and (|1.3I) . We note that in the case of a homo- 
geneous random graph we get a similar system with a slightly different meaning of 
the coefficients. 

3. Momentum approach 

The basic idea of getting an approximating differential equation is to calculate the 
time derivative of the expected value by using the Kolmogorov equations. Since the 
obtained equation is not self-contained, it needs to be closed by using some closure 
approximation. In this Section we derive first equations for the derivatives of every 
moment, then we briefly show how to get the simplest mean- field approximation 
for the first moment. This is also discussed in the case of asymptotically density 
dependent Markov chains. 

3. a. Diflferential equations for the moments. Introducing the moments 

N / L \ " 

(3.1) 2/»W=E h^j P'^W' n = l,2,..., 
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(yi (t) is the expected value we are mainly interested in) we follow Simon and Kiss 
|17) to derive the differential equations for j/„(i) starting from the Kolmogorov 
equations (|KEI) . To get the time derivative of y„ the following Lemma will be used. 

Lemma 2. Let rk (k — 0, l,2,...j he a sequence and let r{t) = X]fc=o ^fePfe(^)' 
where pk (t) is given by (jKEp . Then 

N 

^{I3k{rk+i - rk) + Sk{rk-i - rk))pk- 



N 

r = 

k=0 



Proof. From (|KE[) we obtain 

N N N JV-1 

r = ^ rkPk = ^ rkPk-iPk-i - ^ rkOkPk + ^ rkSk+iPk+i 

k=0 k=l fe=0 A:=0 

Af-1 N N 

= ^ ru+iPkPk - ^ TkakPk + ^ rk-iSkPk- 

k=0 k=0 fc=l 

Using that l3pf ~ 0, Sq — and ak — Pk + 5k we get 

N N 

r = '^{rk+il3k ~rk{(ik + 5k) +rk-i5k)pk = ^(/3fc(?'fc+i -?'fc) +4(rfc-i -rk))pk- 
fc=o fc=o 

n 

Before applying Lemma[2]with rk = (k/N)", it is useful to define the following two 
new expressions 

_ (fc + l)"-fc" -nfc"~i _ (fc - 1)" - fc" + n/c"-! 

Rk,n — _^n-l ' ^k,n — ^ii-l ' 

Let us introduce 

N 
(3.2) d„(t) = ^(/3fei?fe,„ + 4Qfc,n)Pfe(t). 

fc=0 

Combining these with Lemma [2] leads to 

fc=0 

hence 



2^« W = E ( ^ ('"tv^^ + ^"^" ) + 7^ ( '"^YF^ + ^"^" ) ) ^"^^^ 



(3.3) y„(i)^„.f^^^.(^Ay \p,(t) + i.d„(,). 

Using the binomial theorem Rk,n and Qfc.n can be expressed in terms of the powers 
of /c, hence (i„ can be expressed as dn{t) — X]m=i d-mnVmit) with some coefficients 
dnm- The (i„ terms contain N, hence to use the 1/A^ — ?> limit it has to be shown 
that dn remains bounded as N goes to infinity. This is proved in the next lemma. 

Lemma 3. For the functions d„ the following estimates hold 

nin — f ) 
< dnit) < c ■ -^ '- for all t > 0. 
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Proof. Taylor's theorem, with second degree remainder in Lagrange form, states 
that 

fix) = fixo) + nxo){x - xo) + no^-^^^, 

where ^ is between xq and x. This simple result can be used to find estimates for 
both Rk,n and Qk,n- In particular, applying the above result when f{x) — x", 
X = k + 1 and xq — k gives 

_ njn - 1) r-' 

with some ^ e [A:, fc + 1]. Similarly, when x ^ k — I and xq = fc, we obtain 

n{n — 1) ?^"^2 



Qfc 



N 



n-l 



with some r? G [A:,fc + 1]. Hence, i?A:.n and Qk,n are non-negative yielding that 
dnit) > 0. On the other hand, ^/N < 1 and ri/N < 1 and ((rT]) lead to the 
inequality given below 

fl R , X r) ^ njn -I) f (3k 4\ . ri(n - 1) 
Pknk,n + <>kQk,n < t; T7 + TF - "^ 



2 V^ ^/ ~ 2 

Hence, the statement follows immediately from (13.21) and using that J2k=oPk{^') — 
1. D 



We show two possible ways to turn p.3p into an ODE. First, we use the approxima- 
tion E{F{X)) = F{E{X) (where E stands for the expected value and i^ is a given 
measurable function) to derive the mean-field approximation. Then assuming that 
the Markov chain is density dependent and the functions j3 and 5 are polynomials, 
we derive an infinite system of ODEs for the moments. 

3.b. The mean-field approximation. Since di = 0, applying p.3p for n = 1 we 
obtain 

k=a ^ ^ 

Using the asymptotic density dependence of the Markov chain (|1.2p . the right-hand 
side can be approximated by 

In order to make the equation "closed" the approximation 
(3-5) t{p{^)-^{^))-P^it)^p(t^^.,kit^^ 



will be used. Substituting this approximation into the equation (j3.4p we obtain the 
following differential equation 

(ODE) x^ fi(x)-5{x). 

This equation is known as the mean-field approximation of the original Kolmogorov 
equation (jKE|) . 
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3.C. Infinite system of ODEs in the polynomial case. In this Subsection it 
is assumed that the functions in (jl.lD are polynomials and the Markov chain is 
density dependent, that is, 

and 

I I 

(3.7) /3(x) = ^5,x^ S{x)^J2''r' 

j=o j=o 

Using this and denoting 

(3.8) qj:=gj-hj, j = 0,l,...,l, 
from (|3.3D we obtain that 



x-' 



yn{t)=n-^^qA — \ ■ Pk{t) + —dn{t) 

' 1 

(3.9) = " • XI 1]yn+3-l{i) + J^dnit) 

with 

71 • ( 71 — 1 ) 

(3.10) 0<d„(i)<c- ^— '-. 

Letting A'^ — >■ oo on the right-hand-side, we arrive at the following system 

(IE) 71=1,2,..., 

that can be regarded as a system of "approximating" differential equations for 

In Section [S] we are going to investigate how yi{t) can be approximated on finite 

time intervals using the solution of this infinite system. 

Remark 4. All the results for the infinite system obtained from here on remain 
valid in the asymptotically density dependent case when 

| = ;^^,(^)F, |.;^/i,(iv)F 



N ^^'^ ' ' N 



and 



The only difference is that in l\'S.9\i we obtain 

' 1 /I 
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4. Proof of Theorem 1 



In this Section we prove that the solution of (jQDEI) is an 0{\/N) approximation 
of the expected value of the Markov chain, that is we prove Theorem 1 . 
Let us introduce the matrix A^ as in Section [T] 



lAT := 






^1 

-ai 

/3i 




52 

-a.2 


Ss 




\ 








V 








(3n~2 



-ttAT-l 


Sn 

-UN / 



Then the operator families (TV(i))f>o defined as 

form uniformly continuous semigroups on C^~^^ for each N G N. This yields 



_A Art 



(4.1) 

for / = (/o, 



{TN{t)f) 



N 



N , 



fc=0 



\N 



■PjAt) 



, /jv) £ C^+^ where we make the identification 
C^+' = |/:/maps{0,l ^,---,l}to 



Assume for the sake of simplicity that on the right-hand-side of (jODE[) the functions 
/3,6 G C^[0,1]. If we denote the solution of (|ODEp with initial condition xq by 
ip{t,xo), then the operator family defined as 



(4.2) 



{T{t)f){xo) :- fiAt, a:o)), / e C{[Q, 1]), i > 



defines a strongly continuous operator semigroup on C([0, 1]) (see Engel, Nagel [71 
Section 3.28]) with generator {A,D{A)). We also know that for / e CH[0, 1]) 

{Af){xo) = {(3{xo) - S{xo)) ■ f'(xo). 

The main idea is to approximate the semigroup (T'jv(t))j>g (that is, the solution 
of the transposed (jKEp ) using the semigroup (T(0)t>o (that is, the solution of the 
mean-field equation (jODEp ). Observe that the semigroups act on different spaces: 
the first one acts on X^ '■= C^"*"^, the second one on X :— C^([0, 1]). In order to 
prove an approximation Theorem in a fixed space, we assume that there are linear 
operators 



(4.3) Jn ■■ Xn 

(4.4) Pn-X- 



^X, JNi.f):=g, 
Xn, PAr(.9):=/with/(^A^=5(^A 



k = 0,...,N 



such that II Jjvll < 1, II^atH <l, N eE, and 

PnJn=Ix^, NeN; 
JnPnJ ^ /, N^^yj ex 

are satisfied (see Batkai et al. [31 Definition 3.5]). The next Lemma formulates the 
main approximation result in rigorous terms. 
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Lemma 5. Assume that the conditions of Theorem 1 are satisfied. For iTNit))^^^ 
and (r(i))j^Q the following holds: for all f G C^([0,1]) and to > there exists 
C = C(/, ioT > such that for all t £ [0, to] 



(4.5) 



\\{P^Tit)-TNit)PN)f\\<^.. 



where Pn denotes the projection defined in (|4.4p . 

Proof. For the generators An, A, and for / G C^([0, 1]) the following identities 
hold: 



N 



P 



{PnAJ) 



(^-^-^)(iv^=77 



N 



N 



r 



N 



k\ h /(^)-/(#) 



N 



N 



N 



k = 0, ... ,7V. The idea of proving the estimate for the semigroups is to estimate 
the difference of the generators. Their difference can be divided into two parts as 
follows. 



(P-^f){^)-i^-P-f){^) = [\^ 



N \N N r \N 



N r n' 



/(#)-/(V) 



AT 



N 



1_ 

N 



n^) 



The first part can be estimated by using the asymptotic density dependence (II. 5p 
as 



(4.6) 


pi-) 


N 


= 




N 


and 








(4.7) 


\n) 


5k 

N 


= 


i^ 


N 



< 



N 



< 



N 



and using that /' is bounded. 

The second part can be estimated by using Taylor's formula for / G C^([0, 1]). We 

obtain that for each k = 0, . . . ,N there exists £_k G {-^: ^^) such that 



(4.8) 



/(^)~/(#) ,u k 



N 



/'( 



N' 



N 



2 iV2 



- 2^ iiJ II 



(14. 7p that ^, ^ are uniformly bounded for all fc = 0, . . . ,iV and A^ G N. Hence, 



Since /? and S are bounded on [0, 1] (they are in C^[0, 1]), we obtain from (J4.6D and 

for all / G C2([0, 1]) there exists K > such that 

(4.9) 



(PAr^~^^P^)/||<^||,ni + ^|I/'| 



It is easy to see that for all N, the operators T]\[{t) := J]yT]y{t)PN, t > form a 
strongly continuous semigroup on X - where Jn is defined in (|4.3p - with generator 
An := JnAnPn- 

Using the variation of parameters formula (see e.g. Engel, Nagel [71 Corollary 
III. 1.7]), for the difference of the (projected) semigroups, and for / G C2([0,l]) 
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we obtain that 



{PNT{t) - TN{t)PN) I^Pn (T{t)f - TN{t)f) 



PNTN{t-s)[A-AN)T{s)fds 

- / TN{t- s){PnA- ANPN)T{s)f ds. 
Jo 

By the estimate in (j4.9p and using that T{t) maps the subspace C^([0, 1]) of X into 
itself (see Chicone [5j Theorem 1.3]), we obtain that for / e C^([0,1]) there exist 
K* > and L* > 0, such that 

WiPNTit) - T^it)P^) f\\< f^- ||(r(,s)/)"|| + ^ ■ \\{T{s)f)'\\ ds. 



N 



N 



Since P,5 (i C^([0,1]), the solution function ip of (|ODEI) is also a C^-function of 
the initial data. Hence, for s £ [0, t] there exists Kt > such that 

\\{T{s)f)"\\ = IK/ ° ^(s, ■))"ll = ||(/" ° ^) ■ i^r + (/' ° ^) • ^"11 < Kt ■ \\f\\c2 

and similarly ||(T(s)/)'|| < K; ■ ||/||c2. This yields that for / e C2([0,l]) and 
to > there exists C = C(/, to) > such that for all t G [0, to] 

C 



iP^T{t)-TN{t)PN)f\\<- 



D 



Using this semigroup approximation Lemma we can now prove Theorem 1. 

Proof of Theorem 1. We apply Lemma [S] for / = idrp^i]. We obtain that for any 
<o > there exists C = C(id, to) such that for all t G [0, to] 

C 



(4.10) 



\\{PNT{t) ~TN(t)PN)m < 



N' 



Observe that by (j3.ip and (j4.ip . the following relation holds 



N 



k 



^ k ^ 



A; = j=0 



fc=0 

N 



N 



k 



N 



= EP^(0)Eid(^) -P.At) - Ep^(O) • iTN{t)PNid) ijj) 



j=0 fc=0 

= (p(0),TAr(t)P^id). 



J=0 



Furthermore, using (J4.2D it is easy to show that 

(P^T(t)id)(A)^^(t,A). 

It can be seen that it is enough to prove the statement when the initial condition 
is Pm{0) = 1, Pj(0) = 0, j ^ TO. Then yi{0) = ^ yielding a;(0) = ^ and therefore 
x{t) = ip (t, ^). Hence, combining the above facts we obtain 



|yi(t)-x(t)| = (p(0),Tw(t)PArid)-^(t,-) 



(T^(t)Pjvid)(^)-(PArr(t)id)(^) 



< 






where we used (|4.10[) . 
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5. Infinite system of ODEs for the moments 

In this Section we consider the infinite system of ODEs (I3.9p for the moments and 
its formal limit as iV ^- cx) (jIEp . Our aim here is to prove that the solutions of the 
first system converge to those of the second as A^ — >■ oo and t is in a bounded time 
interval. That is, that the moments of the Markov chain converge to the solutions 
of the infinite system (jIEp . As a bi-product of this result we get a completely new 
proof of Theorem 1 under extra sign conditions on the transition rates. 
In order to prove this general convergence result were are going to use the approach 
of Kato 12J and Banasiak et al. [1]. 

Lemma 6. Denote the formal operator 

I 
i^f)n ■= "^ • X! 9j/"+J-i' n = l,2,.... 



3=0 



Let 



Assume that qo,q2, ■ ■ ■ ,qi > 0, qi < and 

(5.1) qo + qi + --- + qi<0; 

(5.2) go - 2^3 - 3^4 - ^5 {I- l)qi < 0. 

Then there exists an operator {L, D) such that L C imax Bind {L, D) is the generator 
of a positive strongly continuous semigroup {T{t))^^Q of contractions on i^. 

Proof. Building the infinite coefficient matrix for £, the assumptions imply that all 
the column sums are less or equal than 0: 

(5.3) 
{n + l)qo + nqi + {n - 1)^2 + {n - 2)^3 + ■ ■ ■ + {n - I + l)qi < 0, n = 1, 2, . . . . 

Hence, using the assumptions on the signs of the q^'s, we can apply Theorem 1 
of Kato in [12 . Though the assumptions of Kato's theorem are referred to the 
equality instead of the inequality in (jS.Sp . the proof works without any changes in 
our case. Thus, we do not repeat the proof here. D 

Let us turn to our original question on the expected value yi{t) - that is, the first 
coordinate of the solution of (|3.9I) . 

Theorem 7. Assume that the conditions of Lemma [^ are satisfied. Then there 
exists an appropriate Banach space of sequences i\j with norm \\ ■ ||t„ such that 
for any initial condition j/o & ^w the solution y{t) := {yn{t))nen of p.9p and the 
solution f(t) := (/„(i))„gp, of ^Q satisfy 

(5.4) ||y(i)-,/(i)IL<^ forte%T], 

that is the solution of p.9p tends to the solution of (|TE| in a finite time interval 

as N — !■ oo. 

Proof. Using the formal operator C as in Lemma the system p.9p can be written 
as 

m - Cy{t) + ld(i), 

(5.5) y(0) = 2/0, 
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where d{t) :— (c^n(O)neN- Denote by ^^ a weighted fi space of sequences such that 
d{t) G 4, t G M+, e.g., 

OO 

II^IL •= X! I^"!*^" ^°'' ^ ^ (2;«)nGN with \r\ < 1. 

n=l 

In this case, by p.lOp . 

OO 

< c- ^n(n- l)r" =: X < OO, teM+. 



n=l 

Applying Lemma |6] on the space £^, we obtain an operator (L^^D^) - acting 
formally as £ - which is the generator of a contraction semigroup (r^(i))t>o '^^ ^w- 
By the formula of variation of parameters for (|5.5p (see, e.g., Engel and Nagel [71 
Corollary III. 1.7]), we have 

1 /■* 

(5.6) y{t) = TUt)yo + ^- TUt- s)d{s) ds 

(5.7) =f(^t) + ^-J T^{t-s)d{s)ds 
for any j/o G £}^,. Thus 

(5.8) ||y(i) - /(t)iL < ^ • / r»(^ - ^)L • IMWIL rfs < ^ • i • i^, 

and this implies (|5.4I) . D 

Remark 8. We note that the sign conditions of Lemma [6] hold in the case of globally 
constrained random link activation-deletion process, but they do not hold in the 
case of an SIS epidemic on a complete graph. 
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